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Many new physics models predict resonances with masses in the TeV range 
^sO ■ which decay into a pair of top quarks. With its large cross section, tt pro- 

duction at the Large Hadron Collider (LHC) offers an excellent opportunity 
to search for such particles. We present a detailed study of the discovery 
potential of the CERN Large Hadron Collider for Kaluza-Klein (KK) excita- 
00 ' tions of the gluon in bulk Randall- Sundrum (RS) models in the tt — > l^vbbqq' 

O ■ (£ = e, fj) final state. We utilize final states with one or two tagged 6-quarks, 

and two, three or four jets (including 6-jets). Our calculations take into ac- 
count the finite resolution of detectors, the energy loss due to 6-quark decays, 
the expected reduced 6-tagging efficiency at large tt invariant masses, and in- 
clude the background originating from Wbb+ jets, (Wb+Wb)+ jets, W+ jets, 
and single top + jets production. We derive semi-realistic 5a discovery limits 
for nine different KK gluon scenarios, and compare them with those for KK 
gravitons, and a Zh boson in the Littlest Higgs model. We also analyze the 
capabilities of the LHC experiments to differentiate between individual KK 
gluon models and measure the couplings of KK gluons to quarks. We find 
that, for the parameters and models chosen, KK gluons with masses up to 
about 4 TeV can be discovered at the LHC. The ability of the LHC to dis- 
criminate between different bulk RS models, and to measure the couplings of 
the KK gluons is found to be highly model dependent. 
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I. INTRODUCTION 



The first physics run of the Large Hadron Collider (LHC) is scheduled for 2008. Investi- 
gating jet, weak boson and top quark production are the prime goals of the 2008 run. Top 
pair production at the LHC, with a cross section which is about two orders of magnitude 
larger than at the Fermilab Tevatron, will make it possible to precisely determine the top 
quark properties [1]. It also offers an excellent opportunity to search for new physics in the 
early operational phase of the LHC. Once the LHC reaches design luminosity, ti production 
will provide access to new phenomena in the multi-TeV region. Many extensions of the Stan- 
dard Model (SM) predict particles which decay into ti pairs, and thus show up as resonances 
in the ti invariant mass, m(ti), distribution. The masses of these particles are typically in 
the TeV range. For example, topcolor [2,3] and Little Higgs [4-8] models predict weakly cou- 
pled new vector bosons, models with extra dimensions [9-11] can have Kaluza-Klein (KK) 
excitations of the graviton [12,13] the weak [11,14,15] and the strong gauge bosons [16-23] 
which couple to top quarks, while massive axial vector bosons appear in torsion gravity mod- 
els [24]. Resonances in the ti channel also occur in technicolor [25,26], chiral color [27] and 
models with a strong 577(3) x SU(3) gauge symmetry [28,29]. In some models [12,16-19], 
the couplings of the new particles to light quarks and gluons is suppressed, and the ti final 
state becomes their main discovery channel. For a model independent approach to search 
for new physics in ti production, see Ref. [30]. 

Top quarks decay either hadronically, t — > Wb — > bqq' (q, q' = u, d, s, c), or semileptoni- 
cally, t — > Wb — > biv (£ = e, /x; decays with r leptons in the final state are ignored here). Pair 
production of top quarks thus results in so-called "di-lepton+jets" events, ti — > ^v^'^vg/bb, 
"lepton+jets" events, it — > £ ± i/bbqq > , or the "all-hadronic" , ti — > bb + 4 quarks, final state. 
Although the di-lepton+jets channel has the smallest background, it suffers from a small 
branching ratio (about 4.7%). Furthermore, the two neutrinos in the final state make it 
impossible to reconstruct the ti invariant mass or the transverse momentum (px) of the in- 
dividual top quark. The all-hadronic final state has the largest branching ratio (~ 46%) but 
also suffers from a very large background. The lepton+jets channel, finally, has a substantial 
branching fraction (about 30%), while the background is moderate. Since the ti invariant 
mass can be reconstructed, albeit with a two-fold ambiguity, it is the premier search channel 
for new physics in ti production. To identify ti lepton+jets events, the LHC experiments 
require an isolated charged lepton, missing transverse momentum, and at least four isolated 
hadronic jets. For events with more than four jets, the four leading (highest transverse 
momentum) jets are selected. Of these four jets two have to be tagged as a 6-quarks [31,32]. 

Searching for ti resonances with masses in the TeV region is challenging for several 
reasons. For top quark transverse momenta larger than a few hundred GeV and ti invariant 
masses above 1 TeV, the top quark decay products are highly boosted and thus almost 
collinear. This frequently results in non-isolated leptons and/or merged or overlapping jets 
for lepton+jets and all-hadronic ti events, ie. the number of jets may be smaller than the 
number of final state quarks. Furthermore, the 6-tagging efficiency in the TeV region may 
be significantly smaller than at low energies [8,17,22]. 

Extending the selection criteria to include topologies with fewer jets and events with 
only one tagged 6-quark is an obvious strategy for improving the selection efficiency for very 
energetic top quarks. On the other hand, this may significantly increase the background. 
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In Ref. [33] we presented a detailed analysis of the tt lepton+jets finals states with 2, 3, or 
4 jets and one or two tagged 6-quarks. We showed that the Iv + 2 jets and tv + 3 jets final 
states with one or two 6-tags significantly improve the chances for discovering new heavy 
particles in the tt channel at the LHC, although the background from W+ jets and single 
top production will be non-negligible in the TeV region, even after imposing suitable cuts. 

In this paper we derive semi-realistic discovery limits for tt resonances in the lepton+jets 
final states using the results of Ref. [33]. We consider Kaluza-Klein excitations of the gluon in 
representative bulk Randall-Sundrum (RS) models, in particular those described in Refs. [18] 
and [19]. Taking into account the finite resolution of the LHC detectors, the energy loss due 
to 6-quark decays, the expected reduced 6-tagging efficiency at large tt invariant masses, and 
the background originating from Wbb+ jets, (Wb + Wb)+ jets, W+ jets, and single top + 
jets production, we derive 5<7 discovery limits and contrast them with those found for KK 
gravitons in bulk RS models [12] and the Z H boson of the Littlest Higgs model [6]. We also 
study how well the KK gluons of various bulk RS models can be discriminated and how well 
their couplings can be determined at the LHC. In Sec. II we present a brief overview of the 
couplings of the KK gluons we consider and give an outline of our calculation. Numerical 
results are presented in Sec. III. Sec. IV contains our conclusions. 

II. KALUZA-KLEIN GLUONS: SIGNAL AND BACKGROUND 

We concentrate on the search for the first excited state of the gluon, G, in variants of 
the RS model with the SM fields propagating in the bulk. Such models can incorporate 
Grand Unification of couplings [34], motivate the flavor hierarchy of fermion masses [35], 
and incorporate a dark matter candidate [36]. Bulk RS models with large brane kinetic 
terms [37] or an expanded custodial symmetry [16,38,39] may be able to protect the Zbb 
vertex from large corrections [38-41]. Specifically, we consider the KK gluons of the models 
of Ref. [19] (E, h i = 1, ... ,4), the basic RS model with the SM in the bulk [17], models 
with large brane kinetic terms with magnitude nr IR = 5 and kt ir = 20, and a model with 
a 5*0(5) x U(l)x bulk gauge symmetry [41]. 

The KK gluons of all models considered here couple uniformly to left-handed and right- 
handed light quarks q — u, d, s, c. The couplings and branching ratios to light, bottom and 
top quarks, g q , g\ — <?i, g R , and g R , and the total width, To, in units of the KK gluon mass, 
M G , are listed in Table I. They agree with the results given in Refs. [18] and [19]. Note 
that KK gluons do not couple vector-like to the quarks of the third generation. The partial 
width for the decay of a KK gluon into a quark- antiquark pair, qq, in the limit M G ^> m q , 
is given by 



where gi (g R ) is the coupling of the left-handed (right-handed) quark to the KK gluon. At 
tree level, KK gluons do not couple to regular gluons. With the exception of models with a 
large brane kinetic term, the couplings of KK gluons to light quarks is suppressed, whereas 
those to top quarks are enhanced. In these models, tt production offers the best chance to 
discover KK gluons. In models with a large brane kinetic term, KK gluons may also be 




(1) 
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TABLE I. The couplings, branching ratios, and the total width in units of the mass, Tg/Mg, 
of KK gluons in various bulk RS models. g s is the strong coupling constant. In order to calculate 
Tq we have assumed that a s = <7 2 /47r = 0.1. N is the number of the additional KK custodial 
partner quarks in the £0(5) model which are light enough that G can decay into them. 
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visible in di-jet production [18]. In all models, except those with a large brane kinetic term, 
the KK gluons are fairly broad resonances. 

All cross sections in this paper are computed using CTEQ6L1 [42] parton distribution 
functions (PDFs). For the CTEQ6L1 PDF's, the strong coupling constant is evaluated 
at leading order with a s (M|) = 0.130. The factorization and renormalization scales for 

the calculation of the tt signal are set equal to \jm 2 t + p^(t), where m t = 173 GeV is 
the top quark mass. The value of the top quark mass chosen is consistent with the most 
recent experimental data [43]. The choice of factorization and renormalization scales of the 
background processes is discussed in more detail below. The SM parameters used in all 
tree-level calculations are [44] 

= 1.16639 x 10~ 5 GeV" 2 , (2) 
M z — 91.188 GeV, M w = 80.419 GeV, (3) 

an 2 6w = l-^y a G , = ^G F s\n 2 9 w M 2 W) (4) 

where Gp is the Fermi constant, M w and M z are the W and Z boson masses, 9 W is the 
weak mixing angle, and is the electromagnetic coupling constant in the G^ scheme. 

We calculate the tt — > iubbqq' cross section at leading-order (LO), including the con- 
tributions from KK gluons and all decay correlations, using the helicity spinor technique 
described in Ref. [45]. Top quark and W decays are treated in the narrow width approxi- 
mation. We require that at least one 6-quark be tagged and that there are a total of two, 
three or four jets in the event. We sum over electron and muon final states and impose the 
following acceptance cuts on lepton+jets events at the LHC (pp collisions at yfs = 14 TeV): 



p T (£)> 20 GeV, \r](e)\ < 2.5, (5) 

p r (7) > 30 GeV, |??(J)I<2.5, (6) 

p T (b)> 30 GeV, \y(b)\<2.5, (7) 

p*rp > 40 GeV. (8) 
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Here, 77 (y) is the pseudo-rapidity (rapidity), £ — e, fx, and j> T is the missing transverse 
momentum originating from the neutrino in t — > hlv which escapes undetected. In addition, 
we impose an isolation cut on the charged lepton and jets by requiring the separation in 
pseudo-rapidity - azimuth space to be larger than 

AR = [(At]) 2 + (A$) 2 ] 1/2 > 0.4. (9) 

Light quark jets from W — > qq' and 6-quark jets are merged if 

AR(i,j)<0A, (10) 

h 3 — <L Q.' 1 b- If a 6-quark jet and a light quark jet merge, their momenta are combined into 
a 6-jet. 

The cuts listed in Eqs. (5) - (8) are sufficient for the LHC operating at low luminosity, 
C < 10 33 cm -2 s -1 . They should be tightened somewhat for luminosities closer to the 
design luminosity, C = 10 34 cm -2 s -1 . However, this will have only a small effect on the 
cross section in the TeV region on which we concentrate in this paper. 

We include minimal detector effects via Gaussian smearing of parton momenta according 
to ATLAS [31] expectations, and take into account the 6-jet energy loss via a parametrized 
function (for details see Ref. [33]). Charged leptons are assumed to be detected with an 
efficiency of q = 0.85. 

At low energies, the LHC experiments are expected to tag 6-jets with an efficiency of 
e b 0.6 [31,32]. However, for very energetic top quarks, the 6-tagging efficiency is expected 
to degrade [17]. As we shall see in Sec. Ill, the range of m{tt) = 2.5 — 4.0 TeV will be of 
interest for KK gluon searches at the LHC. Preliminary ATLAS studies find that, in this 
region, e b is about a factor 3 smaller than at low energies [8,22]. For realistic cross section 
estimates, a parametrization of e b as a function of the 6-quark energy or p T is needed. 
Currently, these do not exist. Except for low energies, e b is known only for a few selected 
values of m(tt) [8,22]. In the following we therefore assume a constant 6-tagging efficiency 
of 6b = 0.2. Note that, for ej, = 0.2, the cross section for final states with one 6-tag is almost 
one order of magnitude larger than that for two tagged 6-quarks. 

New particles which decay into a pair of top quarks lead to resonances in the ti invariant 
mass distribution and to a Jacobian peak in the top quark transverse momentum distribu- 
tion. In the following we therefore concentrate on these observables. The coupling of KK 
gluons to the top quark is reflected also in the pt distribution of the charged lepton, which 
acts as an analyzer of the top polarization [17]. We do not study the pr{£) distribution here. 

Since the neutrino escapes undetected, m{tt) cannot be directly reconstructed. However, 
assuming that the charged lepton and the missing transverse momentum come from a W 
boson with a fixed invariant mass m{lv) = M\y, it is possible to reconstruct the longitudinal 
momentum of the neutrino, Pl{v), albeit with a twofold ambiguity. In our calculations of the 
m(tt) distribution in the lepton+jets final state, we reconstruct the ti invariant mass using 
both solutions for Pl{v) with equal weight. Jets are counted and used in the reconstruction 
of m(tt) if they satisfy Eqs. (6) and (7) after merging. The energy loss of the 6-quarks 
slightly distorts the j> T distribution. As a result, the quadratic equation for Phiy) does not 
always have a solution. Events for which this is the case are discarded in our analysis. This 
results in a ~ 10% reduction of the ti cross section in the m(tt) distribution. More advanced 



5 



algorithms [46] improve the reconstruction of the mass of the new physics signal; however, 
they have little effect on the shape of the SM m(tt) distribution. For the background 
processes, the m(tt) distribution is replaced by the reconstructed Wbb + m jets and Wbj + 
m jets invariant mass distribution. 

In order to reconstruct the t or i transverse momentum one has to correctly assign the 
b and b momenta to the parent top or anti-top quark. Since it is impossible to determine 
the 6-charge on an event-by-event basis, and we do only require one 6-tag in the event, we 
combine ^> T , Pt(£), and the transverse momentum of the jet with the smallest separation from 
the charged lepton to form the transverse momentum of the semileptonically decaying top 
quark. The px's of the remaining jet(s) form the transverse momentum of the hadronically 
decaying top 1 . We find that the reconstructed and true top quark transverse momentum 
distributions are virtually identical except for transverse momenta below 50 GeV where 
deviations at the few percent level are observed. 

The main background processes contributing to the £u+n jet final states with n = 2, 3, 4 
are Wbb + m jets, (Wb + Wb)j + m jets, and Wjj + m jets production, (tb + ib) + m jets, 
(t + t)j + m jets production with t — > biu, and Wbt, Wt and Wjt production with t — > bjj. 
For each process, m — 0, 1, 2, and j represents a light quark or gluon jet, or a c-jet. Wt 
production only contributes to the 2 jet and 3 jet final states. The (Wb + Wb)j + m jets 
((t + t)j + m jets) background originates from Wbbj + m jets ((tb + tb)+m jets) production 
where one of the 6-quarks is not detected. We calculate these processes in the 6-quark 
structure function approximation. We have verified that, for m — 0, the differential cross 
sections f or pp — > Wbj ((t+t)j) and pp — > Wbbj ((tb+tb)j) where one 6-jet is not detected are 
very similar. All background cross sections are consistently calculated at LO. To calculate 
pp — > Wbb + m jets and pp — > Wjj + m jets we use ALPGEN [44]. All other background 
processes are calculated using MadEvent [48]. 

Background processes, such as pp — > Wjj+m jets, where one or two jets are misidentified 
as fe-jets are calculated using a misidentification probability of P q , g ^b = Pj^b = 1/30 (q = 
u, d, s) for light jets, and P c ^b = 1/10 for charm quarks. Preliminary ATLAS studies [22,8] 
have found these values to be appropriate in the tt invariant mass region around 3 TeV which 
is the range on which this paper concentrates. Ideally, one would like to know Pj~>b and 
P c ^b as functions of the jet transverse momentum. Unfortunately, these parametrizations 
are presently not available. 

Wjj + m jets production in ALPGEN includes c-jets in the final state. Since P c ^b is 
considerably larger than P q , g ^b, this underestimates the background from W+ charm pro- 
duction. However, the cross section of W+ charm final states is only a tiny fraction of the 
full Wjj + m jets rate, resulting in an error which is much smaller than the uncertainty 
on the background from other sources. One can also estimate the W+ charm cross section 
from that of pp — > Wbb + m jets and pp — > (Wb + Wb) + m jets. For the phase space cuts 
imposed, quark mass effects are irrelevant. Using the values of P c ^b given in Refs. [8,22,31], 
we find that the (Wc + Wc)j + m jets (Wcc + m jets) cross section is a factor 2 — 10 (5 — 100) 
smaller than the (Wb + Wb)j + m jets (Wbb + m jets) rate for the p T and invariant mass 
range considered here. 



Alternatively, one could select the combination of jets which minimizes \m(jets) — mt\ [47]. 
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bb + m jets production where one 6-quark decays semileptonically also contributes to the 
background. Once a lepton isolation cut has been imposed, this background is known to 
be small for standard lepton+jets cuts [49]. For bb + m jets events to mimic ti production 
with very energetic top quarks, the 6-quarks also have to be very energetic. This will make 
the lepton isolation cut even more efficient. We therefore ignore the bb + m jets background 
here. 

The renormalization and factorization scales, /j, r and [if, of background processes involv- 
ing top quarks are set to m t ; for all other background processes we choose the W mass. Since 
our calculations are performed at tree level, the cross section of many background processes 
exhibits a considerable scale dependence. However, uncertainties on the current 6-tagging ef- 
ficiencies and the light jet mistag probability at high energies introduce an uncertainty which 
may well be larger. Our choice of fi r and /// leads to a rather conservative estimate of the 
background cross sections; other (reasonable) choices such as $ = fj/j = + J2iPr(ji) 2 , 
where i runs over all jets, lead to smaller cross sections, especially at high energies. 

Without further cuts, the background turns out to be much larger than the signal for ti 
invariant masses in the TeV region [33]. The signal to background ratio, however, can be 
improved significantly by imposing a cut 

\m T (j mi J)-m t \ <20GeV (11) 

on the cluster transverse mass, m T , and a cut 

\m(t -> nj) - m t \ < 20 GeV, (12) 

on invariant mass of the n — 1, 2 or 3 remaining jets which are assumed to originate from 
the hadronically decaying top quark. The cluster transverse mass in Eq. (11) is defined by 

m 2 T (j min t) = PrUmiJ) +m 2 (j mi J) + p 1 ^ - (p T (j mi J) + } T ) , (13) 

where pr(Jmm£) an d rn{j min l) are the transverse momentum and invariant mass of the j m in^ 
system, respectively, and j m i n is the jet with the smallest separation from the charged lepton. 
rriT sharply peaks at the top mass. The invariant mass resolution for jet systems with a mass 
near m t is approximately 7—10 GeV for jets with energies above 200 GeV. The invariant 
mass window chosen in Eq. (12) thus will capture most of the ti signal. On the other hand, 
it is sufficiently narrow to reject a large portion of the background. 

In case of only two jets in the final state, we impose Eq. (12) on the jet with the 
larger separation from the charged lepton. In order to estimate the effect of a jet invariant 
mass cut on the Wjj and (t + i)j background, we convolute the differential cross sections 
obtained from ALPGEN and MadEvent with V(m(j top ) , PrUtop)) where j top is the jet with the 
larger separation from the charged lepton (ie. the "t-jet" candidate) [33]. A cut on m(j top ) 
is then imposed (see below). V(m(j),pT{j)) is the two-dimensional probability density 
that a jet with transverse momentum pr(j) has an invariant mass m(j). We calculate 
V(m(j),pT(j)) by generating 10 5 W+ jets events in PYTHIA [50] and passing them through 
PGS4 [51], which simulates the response of a generic high-energy physics collider detector with 
a tracking system, electromagnetic and hadronic calorimetry, and muon system. Jets are 
reconstructed in the cone [52] and kx algorithms [53] as implemented in PGS4, using a cone 
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size (D parameter) of R = 0.5 (D = 0.5) in the cone (kr) algorithm. Since it is infrared safe, 
the kx algorithm is the theoretically preferred algorithm. For a discussion of the advantages 
and disadvantages of the two algorithms at hadron colliders, see Ref. [54]. The cone size 
(D parameter) is deliberately chosen to be slightly larger than in our parton level studies 
to avoid drawing conclusions which are too optimistic. The probability density function, V, 
for the kr algorithm has a much longer tail at large jet invariant masses than for the cone 
algorithm, resulting in a significantly higher background in the m(tt) distribution [33]. In 
order to be conservative, we therefore use the kx algorithm when estimating the background 
in the iv + 2 jets final state. 

The reconstructed m(ti) distribution after imposing the cuts listed in Eqs. (5) - (12) is 
shown in Fig. 1 for the range \Mq — m(tt)\ < 1 TeV. We show the results for the combined 
tt — > iv + n jets final states with n = 2, 3, 4 and one or two tagged 5-quarks, assuming 
efc = 0.2 and q = 0.85. The curves are for SM tt production (solid black line), the combined 
background (blue histogram), and KK gluon production with M G = 3 TeV for the models 
listed in Table I. The transverse momentum distribution of the semileptonically decaying top 
quark is shown in Fig. 2. To avoid overburdening the figures, we show the Ei {i — 1, . . . , 4) 
KK gluon resonances in Fig. la and Fig. 2a, and all others in Fig. lb and Fig. 2b, respectively. 
For comparison, the magenta line in Figs, lb and 2b shows the result for a Zh boson in 
the Littlest Higgs model with M Zh = 3 TeV and cot0 = 1 (see Ref. [6]), where 9 is a 
mixing angle. The Z H vector boson couples purely left-handed and universally to quarks 
and leptons. 

For all models, except that with ktir = 20, the sign of the coupling of the KK gluon 
to light quarks is opposite to that of the larger coupling to the top quark. As a result, in 
those cases, interference effects are positive (negative) below (above) the resonance. Since 
the width of KK gluons in models with a large brane kinetic term is relatively small, the 
resonance curves for these particles are significantly more pronounced than those for other 
KK gluons. For such rather narrow resonances detector resolution effects become impor- 
tant. These effects are included in Figs. 1 and 2 through the smearing of particle momenta 
according to the ATLAS resolution. 

As evident from Fig. 2, the SM non-tt background is significantly smaller in the 
Pr{t — > b£u) distribution than in the tt invariant mass spectrum. Furthermore, the top 
quark transverse momentum distribution does not suffer from the ambiguity associated 
with the reconstruction of the longitudinal momentum of the neutrino. On the other hand, 
the transverse momentum distribution only reflects information encoded in the transverse 
degrees of freedom. 

III. NUMERICAL RESULTS 

We now derive discovery limits for the KK gluon states discussed in Sec. II. We also 
investigate, for Mq = 3 TeV, how well the KK gluon states can be discriminated, and how 
well the couplings of these states can be measured at the LHC, and a luminosity upgraded 
LHC (SLHC) with a total integrated luminosity of 3000 fb _1 . 

As the statistical tool of choice we adopt a log likelihood test. Our expression for the 
log-likelihood function is 
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FIG. 2. The LO differential cross section of the combined SM tt — > Iv + n jets (n = 2, 3, 4) 
signal (black line), the combined background (blue histogram), and a bulk RS KK gluon, G, with 
Mq = 3 TeV as a function of the reconstructed transverse momentum of the semileptonically 
decaying top quark. One or two of the jets are assumed to be 6-tagged. Part a) of the figure shows 
the results for Ei (i = 1, . . . , 4) KK gluons, part b) shows the resonance curves for the remaining 
KK gluon scenarios summarized in Table I. For comparison, the magenta line in b) shows the 
result for a Zh boson in the Littlest Higgs model with a mass of 3 TeV and cot 9 = 1 (see Ref. [6]). 
The cuts imposed are discussed in the text. 
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-21ogL = -2 



E i-fsSi - f B B t + n 0l \og(f s S z + f B Bi) - log(noi!)) 



+ (^~ 1 ) 2 + Ub - I) 2 (M) 

The sum extends over the number of bins, Si and Bi are the number of signal and background 
events in the ith bin, and is the number of reference (eg. SM) events in the ith bin. The 
uncertainties on the signal and background normalizations are taken into account via two 
multiplicative factors, fs and /#, which are allowed to vary but are constrained within the 
relative uncertainties of the signal and background cross sections, A/5 and A/b, respectively. 
The background consists of SM tt production, and SM non-tt background as discussed in 
Sec. II. 

Since both the m(tt) and the px{t — > blv) distributions have advantages and disadvan- 
tages, we use both in deriving discovery and sensitivity limits for the couplings of KK gluons. 
As we do not take into account common systematic uncertainties in our analysis, this pro- 
cedure will lead to somewhat optimistic limits. If we use only the distribution which yields 
the tightest individual bounds, the results presented in this Section worsen by 10 — 20%. 

Except for the SM tt cross section, and the backgrounds contributing to the Iv + 2 jets 
final states, cross sections are only known to leading order in QCD and thus depend signif- 
icantly on the renormalization and factorization scales used. In the following, we assume 
that QCD corrections do not significantly change the shape of the distributions analyzed in 
the region which contributes most to the statistical significance. Furthermore, we assume 
that the uncertainties for signal and background from the unknown QCD corrections are 
approximately equal, js — Jb — /• In this case, logL can be minimized analytically and 
one finds the minimum of log L to occur at 

/ = \ (l - (A/) 2 iV + ^/(l-(A/W + 4(A/)2iV ) , (15) 

where 

N^iSi + Bi) (16) 

i 

is the total number of events, 

Wo = E"« (17) 

i 

the total number of reference events, and A/ is the uncertainty of the reference cross sec- 
tion. In the following we take A/ = 0.3. The results which we present below only minimally 
depend on the choice of A/, reflecting that the normalization of the background can be 
obtained from the low energy part of the m(tt) and pr(t — > blv) distributions. Uncertainties 
from parton distribution functions, and from varying the factorization and renormalization 
scales are ignored in our calculation. Uncertainties from the poorly known 6-tagging ef- 
ficiency and light quark/gluon jet misidentification probability are likely to be larger and 
difficult to quantify without actual LHC data or more accurate simulations. 
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TABLE II. Approximate 5a discovery limits for the KK gluons introduced in Sec. II for 100 fb 1 
and 300 fb" 1 of data at the LHC. For comparison, we also show discovery limits for a Zh boson in 
the Littlest Higgs model with cot 9 = 1, and a bulk RS KK graviton with M4L = 1 and v t ,R = 1- 
See text for more details. 



Model 


limit 100 fb" 1 


limit 300 fb" 1 


Model 


limit 100 fb" 1 


limit 300 fb" 1 


Basic RS 


3.8 TeV 


4.3 TeV 


Ei 


3.9 TeV 


4.4 TeV 


nr IR = 5 


3.4 TeV 


3.9 TeV 


E2 


3.6 TeV 


4.2 TeV 


nr IR = 20 


3.5 TeV 


4.1 TeV 


E3 


3.8 TeV 


4.2 TeV 


SO(5), N = 


3.4 TeV 


4.0 TeV 


E 4 


3.4 TeV 


4.2 TeV 


SO{5), N = 1 


2.4 TeV 


3.0 TeV 


Z H 


2.6 TeV 


2.8 TeV 


KK graviton 


1.3 TeV 


1.4 TeV 









A. Discovery limits 

In order to derive discovery limits for the KK gluons introduced in Sec. II at the LHC 
we require a 5 standard deviation significance 

-21ogL>25 (18) 

from the SM prediction in the combined reconstructed ti invariant mass, and px{t — > biv) 
distribution. Results for 100 fb -1 and 300 fb" 1 of data are shown in Table II. For comparison, 
we also list the 5<r discovery limits for a Z H boson in the Littlest Higgs model with cot 6 — 1, 
and for a bulk RS KK graviton, G r , which is dominantly produced via gluon fusion [12]. 

To calculate the cross section for G r production via gluon fusion in the ti channel we 
use the formulas of Ref. [12] with M 4 L = 1 and v tR — 1- Here M4 is the Planck scale, L is 
the inverse of the AdS curvature scale, and v tR is a parameter related to the bulk mass for 
fermion fields. The gg — > G r — > ti cross section scales like (M 4 L)~ 4 and (1 + 2i> ttR ) 2 . 

The discovery limits for KK gluons in all models considered are, except for the 5*0(5) 
model with jV = 1, in the range 3.4 - 3.9 TeV (3.9 - 4.4 TeV) for 100 fb" 1 (300 fb" 1 ). 
In the 5*0(5) model with N — 1, the first KK excitations of the fermions are assumed to 
be sufficiently light so that KK gluons can decay into those. As a result, the KK gluon 
in this model is a very broad resonance (see Table I) which makes it considerably more 
difficult to detect. Our discovery limits for the basic RS case are in general agreement with 
those obtained in Ref. [16]. Note that KK gluons in models with a large bulk kinetic term 
( Kr m = 5 and kt ir = 20) couple more strongly to light quarks than top quarks and thus 
can be searched also for in di-jet production [18]; however, no quantitative discovery limits 
for this channel have been derived yet. Precision electroweak data allow KK gluons with 
mass as low as 2 — 3 TeV [55] . The LHC thus should be able to significantly constrain bulk 
RS models. 

We do not list discovery limits for an upgraded LHC with 10 times the integrated lumi- 
nosity of the LHC (SLHC). Using a 6-tagging efficiency of e& = 0.2, which is appropriate for 
ti invariant masses of (9(3 TeV), we obtain 5<r limits of Mq > 5 TeV for KK gluons with an 
integrated luminosity of 3000 fb" 1 . However, some caution is in order because a 6-tagging ef- 
ficiency of 6fe = 0.2 may well be too optimistic at such huge invariant masses. Unfortunately, 
currently no estimates exist for at the SLHC in the vicinity of m(tt) = 5 TeV. 
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The Zh boson couples with weak coupling strength to fermions. It is therefore not 
surprising that the discovery limits for a boson in the tt channel are substantially weaker 
than those for most KK gluons. Since the Z H boson also couples to charged leptons, the 
£ + l~ final state is an obvious channel to search for such a particle. It should be possible to 
find a Z H with mass up to 5 TeV in di-lepton production at the LHC with 300 ftr 1 [5]. 

The discovery limits for bulk RS KK gravitons are about a factor 3 weaker than those 
for KK gluons due to the strongly suppressed G r gg coupling. However, the limits listed for 
bulk RS KK gravitons in Table II are likely conservative. The 6-tagging efficiency in the tt 
invariant mass range of 1 — 1.5 TeV is estimated to be a factor 1.5 — 2 higher than what we 
have used in our calculation [8,22]. This will increase the 5a discovery limits for bulk RS 
KK gravitons by approximately 100 - 200 GeV. For u tjR < 1, the ZZ [56] and WW [57] 
channels may offer better chances to discover bulk RS KK gravitons. 

In Ref. [12] G r discovery limits were derived as a function of the top quark detection 
efficiency, without taking into account the non-tt background. Our calculation attempts to 
provide a more quantitative estimate, taking into account the non-tt background, and the 
reduced 6-tagging efficiency at large invariant masses. 

B. Discriminating KK gluon models 

Once a resonance in the ti channel has been discovered, it becomes important to de- 
termine its properties in order to pin down the underlying new physics. The spin of the 
new particle can be determined by measuring the angular distribution of the top quarks: a 
scalar particle leads to an isotropic distribution, a vector boson to a distribution which is 
proportional to (1 + cos 2 9), whereas the angular distribution for spin 2 particle will have a 
(1 — cos 4 #) dependence [12,58]. Here, 9 is the scattering angle of the top quark. Important 
clues can also be obtained from other final states in which the same resonance has been 
observed. 

For the following discussion we assume that a spin 1 resonance has been found in the 
tt channel, however, has not been observed elsewhere. In such a situation, KK gluons in 
bulk RS models become natural candidates for the state observed and it becomes interesting 
whether a measurement of the resonance curve in the m(ti) and the pr(t — > blv) distribution 
will be able to discriminate between different bulk RS models. 

In order to address this question, we pursue two approaches. In this Section, we calculate 
the "discrimination matrix" for KK gluons in the nine bulk RS models we are considering. 
In Section III C, we derive 68.3% confidence level (CL) bounds for the couplings of KK 
gluons. For our case study, we assume a mass of Mq = 3 TeV for the KK gluon. This 
guarantees that the LHC will be able to detect such a particle with a significance of more 
than 5<t in all models studied here, except the SO (5), N = 1 case. 

The discrimination matrix is constructed by performing a log likelihood test for each pair 
of bulk RS models, assuming that one is correct and finding the significance of the other 
model as a test. The results for Mq = 3 TeV and an integrated luminosity of 100 fb _1 are 
presented in Table III. For smaller (larger) KK gluon masses higher (lower) significances 
are expected. 

Table III shows that the Ei models can only be distinguished at the 1.5 — 3<x level. 
However, the remaining models can be discriminated with a significance of 4 — 10a. The 
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TABLE III. Discrimination matrix for the KK gluons introduced in Sec. II for Mq = 3 TeV and 
an integrated luminosity of 100 fb _1 at the LHC. The model in each column is assumed to be the 
correct, measured model, and is tested against the hypothesis in each row. Since the discrimination 
matrix is symmetric in the limit of large statistics, we only show the entries above the diagonal. 



Model 


basic RS 


KVIR = 5 


Kr IR = 20 SO(5), N = 50(5), N = 


1 Ei 


E 2 


E 3 


E 4 


basic RS 


O.Ocr 


6.1a 


10.5a 


3.1a 


7.5a 


1.7a 


2.9a 


0.0a 


2.9a 


nr IR = 5 




0.0a 


5.2a 


4.3a 


7.3a 


7.1a 


7.2a 


5.4a 


6.0a 


Kr IR = 20 






0.0a 


7.8a 


9.9a 


10.9a 


10.9a 


9.3a 


9.7a 


SO(5), N = 








0.0a 


4.8a 


3.7a 


3.3a 


2.8a 


1.9a 


SO(5), N = 1 










0.0a 


6.8a 


5.5a 


6.8a 


4.3a 


Ei 












0.0a 


1.5a 


2.0a 


2.7a 


E 2 














0.0a 


3.2a 


1.6a 


E 3 
















0.0a 


3.2a 


£4 


















0.0a 



Ei models and non-Z?j models, finally, can be separated at the 2 — 11a level, except for the 
basic RS and the E 3 model which will be very hard to discriminate through a measurement 
of the resonance curve for the mass and the integrated luminosity chosen. This can be 
easily understood. At the resonance peak, m(tt) = Mq, the qq — > G — > tt cross section is 
proportional to Br(G — > qq) ■ Br{G — > tt), where q = u, d, s, c denotes a light quark. For 
a KK gluon in the basic RS and the E 3 model, the product of the two branching fractions 
accidentally agrees within 15%, making it very difficult to discriminate between the two 
models. Nevertheless, Table III demonstrates that a measurement of the resonance curve 
with a luminosity of 100 fb" 1 may well be able to eliminate a number of bulk RS models. At 
a luminosity upgraded LHC it should be possible to measure the couplings of a KK gluon 
candidate rather well, and, perhaps, uniquely identify the underlying bulk RS model nature 
may have chosen. 

C. KK gluon coupling analysis 

The interactions of KK gluons in the Ei models and models with a large brane kinetic 
term kti R are characterized by four couplings, g q , g\ = g\, g b R , and g R . In all other 
models considered here, g b R = g q , and there are only three independent couplings. A precise 
measurement of the Breit-Wigner resonance curve of KK gluons should make it possible to 
determine at least some of the couplings of KK gluons. Since the 6-quark parton densities 
are much smaller than those of the light quarks, bb — > G — > tt contributes little to the KK 
gluon cross section, even when g\ R is much larger than the SM strong coupling constant 
(eg. in the E 2 and E 4 models). This makes it essentially impossible to directly measure 
g b LR - However, g q , g\ and g R can, in principle, be measured. 

The dependence of the tt cross section on the KK gluon couplings is of Breit-Wigner form. 
Since the width of the KK gluons depends on the coupling constants, the dependence of the 
tt cross section on the KK gluon couplings is sufficiently complicated to make the numerical 
extraction of sensitivity bounds very CPU time consuming when all three couplings are 
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varied simultaneously. We do not attempt such a general analysis here. Instead, in order 
to get a general idea of how well the couplings of a spin 1 resonance in the tt channel may 
be determined at the LHC, we derive sensitivity limits for the following two limiting cases 
which are of interest for the models discussed here, and which greatly simplify the numerical 
analysis. 

1. The total width of the resonance (see Eq. (1)) is dominated by one coupling. Models 
which fall into this category are the basic RS, E 1 and E 3 models where g R dominates 
the width, the 5*0(5), N — 0, model where g\ dominates, and the models with a 
large brane kinetic term nr IR where the width is dominated by g q . Since the contri- 
butions of the other two couplings to the total width is negligible, the cross section is 
approximately bi-linear in these couplings. This makes it possible to analytically solve 
for the coefficients multiplying these couplings in each bin of the distributions which 
are analyzed, provided that the coupling which dominates the width is treated as a 
constant. These coefficients are valid for arbitrary values of those couplings which are 
varied, even in regions where the dependence of the total width on those couplings can 
no longer be neglected. As a result, it becomes straightforward to derive one- and two- 
dimensional sensitivity bounds for these couplings. In order to ensure that our results 
remain valid for large deviations of the couplings from their predicted values, we do 
take into account the dependence of the width on the couplings when deriving limits. 
Whenever we derive bounds for those couplings which have a negligible impact on the 
total width of the KK gluon, we assume that the third coupling (which dominates the 
width) has the default value predicted by the model considered. 

Naively, one may think that the cross section should be most sensitive to the coupling 
which dominates the total width, gdom- However, this is not the case. Most of the 
sensitivity comes from the immediate vicinity of the resonance, m{tt) = M G . At the 
resonance peak, the dependence of the numerator and the denominator on gdom m the 
square of the KK gluon amplitude approximately cancels. In addition, the interference 
term between the KK gluon and the SM amplitude vanishes for m(tt) = Mq. As a 
result, the cross section is quite insensitive to the coupling which dominates the total 
width. 

In the following, we will derive sensitivity limits for gdom-, assuming that the two other 
couplings are fixed to the values characteristic for the model under consideration. 

2. In the remaining models, each coupling, unless it grossly deviates from its predicted 
value, has only a small effect on the total width. In this case we follow the approach 
outlined above for such couplings and derive one- and two-dimensional sensitivity 
limits. 

In the following we present 68.3% confidence level (CL) limits for g q , g b L = g f L , and g R , and 
M G = 3 TeV. A KK gluon with a mass of 3 TeV can be discovered with a 5a significance or 
better in all models considered here, except the SO (5) model with N — 1. We derive limits 
for integrated luminosities of 100 fb _1 and 300 fb _1 at the LHC, and 3000 fb _1 at the SLHC. 
As before, we combine information from the m(tt) and the pr{t blv) distributions. For 
smaller (larger) KK gluon masses, more (less) stringent limits on the couplings are obtained. 
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TABLE IV. 68.3% CL limits for the couplings of a KK gluon with mass M G = 3 TeV for 
various integrated luminosities at the LHC and SLHC. Results are show for the basic RS model, 
the SO(5) model with N = and N = 1, and two models with a large brane kinetic term nrm. 
Only one coupling at a time is varied. All limits are given in units of the QCD coupling constant 
9s- 



basic RS model 



50(5) 



JCdt 



100 fb 



-l 



300 fb~ x 3000 fb~ 



JCdt 



100 fb" 1 


300 fb" 1 


3000 ftr 


+0.026 


+0.016 


+0.004 


-0.018 


-0.010 


-0.005 


+0.068 


+0.036 


+0.010 


-0.032 


-0.022 


-0.010 


+0.65 


+0.42 


+0.05 


-0.70 


-0.35 


-0.04 


+0.60 


+0.41 


+0.23 


-0.52 


-0.36 


-0.17 


+0.37 


+0.26 


+0.14 


-0.34 


-0.22 


-0.12 


+0.67 


+0.51 


+0.24 


-0.47 


-0.32 


-0.16 


Kr IR = 20 



-0.2 



9l = 1 



A 



+0.018 
-0.014 



+1.07 
-0.50 



+0.64 
-0.80 



+0.009 
-0.010 



+0.66 
-0.31 



+0.21 
-0.39 



+0.003 
-0.003 



+0.18 
-0.14 



+0.05 
-0.04 



A 



A 



-0.2 



2.76 



0.07 



N = 



N = 1 



N = 



N = 1 



N = 



N = 1 



uriR 



JCdt 



100 fb- 1 


300 fb" 1 


3000 fb~ 


+0.14 


+0.10 


+0.02 


-0.09 


-0.06 


-0.03 


+0.38 


+0.28 


+0.05 


-0.11 


-0.07 


-0.04 


+0.05 


+0.03 


+0.01 


-0.07 


-0.04 


-0.01 



JCdt 



100 fb- 1 


300 fb" 1 


3000 ftr 


+0.36 


+0.19 


+0.03 


-0.15 


-0.09 


-0.02 


+0.05 


+0.04 


+0.01 


-0.06 


-0.02 


-0.01 


+0.21 


+0.13 


+0.03 


-0.14 


-0.06 


-0.03 



A 



-0.4 
-0.2 



9r = 0-6 



A 



A 



-0.8 
-0.6 
-0.2 



Sensitivity limits for the case when only one coupling at a time is varied are presented 
in Tables IV and V. In all models, except those with a large brane kinetic term Krm, the 
coupling to light quarks can be measured with a precision of 10 — 15% for 100 fb -1 , and to 
5% or better for 3000 fb -1 . In models with a large brane kinetic term Kr IR , decays into light 
quarks dominate the width (see Table I), and g q can only be determined with an accuracy 
of 35 - 45% (4 - 8%) for 100 fb" 1 (3000 fb" 1 ). Note that, in addition to the allowed range 
for g q listed in Tables IV and V, an interval around g q = cannot be excluded. 

Similarly, the coupling to left-handed top quarks can be measured with a precision of 
10 - 100% (2 - 20%) for 100 fb- 1 (3000 fb' 1 ) except in the model with nr IR = 5 where 
more than 300 fb -1 are needed in order to rule out a vanishing of g l L . Similar accuracies 
are achievable for g R , except in the SO(5) model where g R almost vanishes and it will 
be impossible to establish a non-vanishing coupling of the KK gluons to right-handed top 
quarks even at the SLHC. 

The bounds on g\ R are in many cases significantly weaker than those for g q . In many 
of the models considered here, g* L <C g R with g R being the coupling which dominates the 
width, or g R <^ g l L , and g\ dominates the KK gluon width. Since the differential cross 
section contains terms proportional to g l j* + g l R and g t L + g R , it is obvious that the sensitivity 
to g l L R is significantly reduced in such models. 
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TABLE V. 68.3% CL limits for the couplings of a KK gluon with mass Mq = 3 TeV for various 
integrated luminosities at the LHC and SLHC. Results are show for the Ei, i = 1, ... ,4 models. 
Only one coupling at a time is varied. All limits are given in units of the QCD coupling constant 
g s . Ei and E2 (£3 and E4) KK gluons differ only in the strength of their coupling to right-handed 
6-quarks, see Table I. 



Ei 


E2 


JCdt 


100 fb- 1 




300 fb" 1 


3000 fb" 1 


JCdt 


100 fb" 1 


300 fb" 1 


3000 fb" 1 


g q = -0.2 


+0.018 
-0.012 




+0.010 
-0.008 


+0.003 
-0.003 


9 q = -0.2 


+0.023 
-0.015 


+0.012 
-0.010 


+0.004 
-0.004 


A = 1-34 


+0.72 
-0.44 




+0.58 
-0.32 


+0.23 
-0.14 


A = 1-34 


+0.90 
-0.83 


+0.65 
-0.57 


+0.24 
-0.22 


9r = 4-9 


+0.90 
-0.90 




+0.53 
-0.42 


+0.22 
-0.14 


9r = 4-9 


+0.80 
-1.02 


+0.58 
-0.64 


+0.24 
-0.21 


£3 


E 4 


JCdt 


100 fb" 1 




300 fb" 1 


3000 fb" 1 


JCdt 


100 fb" 1 


300 fb" 1 


3000 fb" 1 


gi = -0.2 


+0.020 
-0.014 




+0.011 
-0.008 


+0.003 
-0.003 


9 q = -0.2 


+0.026 
-0.017 


+0.014 
-0.008 


+0.004 
-0.004 


A = 1-34 


+0.54 
-0.64 




+0.35 
-0.38 


+0.11 
-0.12 


g\ = 1-34 


+0.76 
-0.74 


+0.48 
-0.47 


+0.18 
-0.16 


9 R = 3.25 


+0.66 
-0.80 




+0.37 
-0.43 


+0.12 
-0.12 


g R = 3.25 


+0.50 
-0.68 


+0.32 
-0.52 


+0.14 
-0.16 



By varying only one coupling at a time, we ignore correlations between different cou- 
plings. These correlations are expected to be particularly pronounced between g q and g\ R - 
This is easy to understand: the shape of the resonance curve may not change appreciably 
if the magnitude of g q decreases, and that of the top quark coupling increases by a corre- 
sponding amount. Examples of two-dimensional sensitivity limits in the g q — g\ plane are 
shown in Fig. 3 for Mq = 3 TeV. 

As expected, strong correlations are observed between g q and g l L . In some cases, the 
limits weaken so much when both couplings are varied simultaneously that T G /M G becomes 
of Oil), and one has to worry about S'-matrix unitarity being violated. In this region, the 
bounds on g q and g l L , of course, become unreliable. The region in which Tg/Mg > 0.5 is 
indicated by dashed lines in Fig. 3. Note that the correlations between the couplings become 
progressively smaller with increasing integrated luminosity. 

The results shown for the SO (5) model with N — 1 deserve further discussion. Figure 3b 
shows that it will be impossible to place an upper bound on g\. Even with 3000 fb -1 , a 
very narrow funnel remains where it is not possible to distinguish g l L and g q from the SO (5) 
model with N — 1. However, much of that funnel lies in the region where possible unitarity 
violations cast doubt on the reliability of our results. The peculiar shape of the contour limits 
in the SO (5) model with N = 1 can be easily understood by recalling that the coupling of 
the KK gluon to right-handed top quarks almost vanishes in this model (see Table I). In 
the limit where g R = and Tg does not change appreciably when g q and g* L are varied, the 
Breit-Wigner resonance curve does not change as long as the product g q g l L remains invariant. 
The line of constant g q g\ is indicated by the magenta line in Fig. 3b. In practice, the small 
but non-zero value of g R = 0.07, and the variation of r G are responsible for the deviation 
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Ag q Ag q 

FIG. 3. Projected 68.3% CL bounds on the couplings of KK gluons with Mq = 3 TeV to light 
quarks, g q , and left-handed top quarks, g f L , in a) the basic RS, b) the 50(5) with N = 1, c) 
the E 2 and d) the E\ model at the LHC with an integrated luminosity of 100 fb _1 (black lines), 
300 fb _1 (red lines), and 3000 fb _1 (blue lines). The coupling of the KK gluon to right-handed top 
quarks is assumed to have the default value of the model considered (see Table I). The bounds are 
obtained from a log-likelihood analysis which combines information from the m{tt) and pr(t — ► blv) 
distributions. Ag q and Ag^ are the deviations from the default values of the coupling constants 
predicted by the model considered. The magenta line in part b) indicates those couplings for which 
the product g q g t L is equal to the value predicted for the 50(5) model with N = 1. 

of the allowed coupling parameters from the line of constant g q g t L . The extremely strong 
correlations between g q and g l L make it very difficult to pin down these couplings in the 
SO (5) model with N = 1. Correlations between g q and g l R) and g\ and g^, however, are 
small in this model. 

In Fig. 4 we compare the limits which can be achieved for g q and g\ with 100 fb -1 in 
the E\ and E% models, and the E% and E4 models, respectively. KK gluons in the E\ and 
E 2 models differ only by their coupling to the right-handed 6-quarks, and the total width. 
Similarly, in the E 2 and E4 models, only the coupling of the KK gluons to right-handed top 
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Results are shown for Mq = 3 TeV and 100 fb -1 . The coupling of the KK gluon to right-handed top 
quarks is assumed to have the default value of the respective model (see Table I). The bounds are 
obtained from a log-likelihood analysis which combines information from the m(tt) and pr(t — > b£u) 
distributions. Ag q and A 5^ are the deviations from the default values of the coupling constants 
predicted by the model considered. 
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quarks and the total width differ. Figure 4 demonstrates that the sensitivity limits for g q 
and g l L in the Ei models depend only modestly on other coupling parameters. Qualitatively 
similar results are obtained for 300 fb _1 and 3000 fb _1 . 

Strong correlations may also occur between g q and g R . As an example, we show the two 
dimensional 68.3% CL sensitivity limits in the g q — g R plane for the E 2 and models and 
Mq = 3 TeV in Fig. 5. In order to pin down g R with a precision of O(10%) in these models, a 
luminosity upgrade of the LHC is needed. Similar correlations are observed between g q and 
g\ in the two models (see Fig. 4). On the other hand, g\ and g R display little correlation. 

However, strong correlations between couplings are not only observed between g q and 
9l,ri but also between the couplings of KK gluons to left- and right-handed top quarks. 
Figure 6 shows 68.3% CL limits for g\ and g R in two models with a large brane kinetic term 

Figures 3-6 demonstrate that one-dimensional limits on the couplings of KK gluons may 
be totally misleading. Although the correlations between couplings become progressively 
smaller with increasing integrated luminosity, they may still significantly weaken sensitivity 
limits at the SLHC, in some cases by up to a factor 3. Although we have not studied the 
correlations for cases where one of the couplings dominates the KK gluon width, we expect 
that strong correlations may also occur there. While it will only be possible to obtain a 
limited amount of information on the couplings of KK gluons at the LHC with 300 fb~ x 
or less of data when correlations are included, it will be possible to measure them with a 
precision of 5 — 50% at the SLHC. 

IV. DISCUSSION AND CONCLUSIONS 

Many New Physics models predict the existence of new particles decaying into a tt pair 
with masses in the TeV region. They lead to a peak in the ti invariant mass distribution 
and a Jacobian peak in the pr(t) differential cross section. In this paper we specifically 
studied the production of KK gluons in bulk RS models in the tt channel at the LHC. Since 
the couplings of KK gluons to light quarks is suppressed in many bulk RS models, the tt 
final state becomes their main discovery channel. The lepton+jets final state offers a good 
opportunity to search for such particles. 

The search for resonances in the tt channel with masses in the TeV region requires the 
reconstruction of very energetic top quarks which faces two major difficulties. Firstly, very 
energetic top quarks are strongly boosted, and their decay products are highly collimated. 
This leads to overlapping and merging jets from hadronically decaying top quarks. Secondly, 
the tagging efficiency for 6-quarks in ti events with very energetic top quarks may be up to 
a factor 3 smaller, and the misidentification probability of light quark or gluon jets may be 
up to a factor of 3 higher, than at low energies. This reduces the number of tt events which 
can be identified, and increases the background. 

As we have shown in Ref. [33], these problems can be partially overcome by considering 
the Iv + n jets final states with one or two tagged 6-quarks and n = 2, 3, 4 instead of 
the canonical tv + 4 jets final state with two 6-tags, and by imposing suitable invariant 
mass and cluster transverse mass cuts. Using the results of Ref. [33], we calculated 5a 
discovery limits for KK gluons in nine different bulk RS models by combining information 
from the ti invariant mass, and the px(t — > blv) distribution. Although information on the 
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longitudinal degree of freedom is lost in the pr(t — * btv) distribution, it has the advantage 
of a substantially smaller SM non-tt background. Our calculation takes into account the 
typical momentum resolution of an LHC experiment, particle identification efficiencies, and 
the energy loss due to 5-quark decay. 

Assuming a 6-tagging efficiency of = 0.2 and a light quark/gluon jet misidentification 
probability of Pj^b — 1/30, as suggested by preliminary ATLAS simulations [31,32], we 
found that, in most models considered, KK gluons with a mass of up to 3.5 — 4 TeV (4 — 
4.5 TeV) can be discovered at the LHC with an integrated luminosity of 100 fb _1 (300 fb _1 ). 
For comparison, electroweak precision measurements require KK gluons in bulk RS models 
to be heavier than 2 — 3 TeV [55]. The LHC should therefore be able to considerably 
constrain such models. 

For comparison, we also listed the discovery limits for the Zh boson in the Littlest Higgs 
model, and the KK graviton in bulk RS models in the ti channel. The discovery limits for 
the Z H boson are about a factor 1.5, and those for the KK graviton are more than a factor 2, 
weaker than those for KK gluons. In both cases, other final states may offer a better chance 
to search for these particles: the Zh boson can be discovered in Drell-Yan production with 
masses up to 5 TeV, whereas a KK graviton in bulk RS models can be found in the WW 
final state with masses up to 3.5 TeV. 

We also investigated, for the example of a KK gluon with mass M G = 3 TeV, how well 
different bulk RS models can be distinguished through a measurement of the KK gluon 
resonance curve. We found that, for 100 fb -1 , the Ei models can only be distinguished at 
the 1.5 — 3<t level. However, the remaining models can be discriminated with a significance 
of 4 — 10o\ The Ei models and non-Ei models, finally, can be separated at the 2 — 11a 
level, except for the basic RS and the E 3 model which will be very hard to discriminate 
from a measurement of the KK gluon resonance curve. The conclusion to draw from this 
investigation is that the Breit-Wigner resonance curve in the ti final state does have some 
analyzing power, and thus may be helpful in discriminating new physics models. 

Finally, we studied how well the KK gluon couplings can be measured at the LHC 
and SLHC. In the E iy i = 1, ... ,4 models, the coupling to the right-handed 6-quark is an 
independent parameter. Since 6-quark fusion contributes only little to the KK gluon cross 
section, it will be impossible to determine the Gb^b^ coupling from the shape of the KK gluon 
resonance curve in the ti final state. The remaining three couplings, g q , g\ = g* L , and g f R , 
however, can be constrained from an analysis of the m(ti) and px{t — > biv) distributions. We 
presented one- and two-dimensional 68.3% CL limits for these couplings. In several models, 
one coupling completely dominates the KK gluon width. Since interference effects vanish, 
and the dependence on the coupling which dominates the width approximately cancels, at the 
peak position of the Breit-Wigner resonance where most KK gluon events are concentrated, 
it will be difficult to precisely measure this coupling. We also found that correlations between 
couplings may strongly affect the sensitivity bounds which can be achieved. Nevertheless, 
at the SLHC, it should be possible to determine the couplings of a KK gluon resonance with 
a mass of up to 3 TeV with a precision of 5 — 50% in most models. 

Our results are subject to a number of uncertainties and thus should be interpreted with 
care. Foremost, since most background processes are not known at NLO, all our signal and 
background calculations have been carried out at LO, and thus are subject to substantial 
renormalization and factorization uncertainties. A perhaps even larger uncertainty originates 
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from the 6-tagging efficiency and the light quark and gluon jet misidentification probability 
at large tt invariant masses, which is only poorly known at present. PDF uncertainties, on 
the other hand, appear to be relatively small [59]. 

The numerical results presented here were obtained by combining information from the 
m{tt) and the prit — > blv) distributions. Since we ignore correlated systematic uncertainties, 
our results are somewhat optimistic. On the other hand, our background estimate has 
been deliberately conservative. Furthermore, in future studies one may include additional 
distributions in the analysis such as the transverse momentum distribution of the charged 
lepton which is sensitive to the chirality of the coupling of the KK gluon to the top quark. 
This could potentially improve the accuracy on the KK gluon couplings which may be 
obtained at the LHC and SLHC. 
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